Module 13: Local Optimization Algorithms and Neural Networks

Homework

Homework 7 is due in two weeks, Sunday at midnight

Learning Objectives

  • Neural Network Learning and Backpropagation
  • Gradient Descent
  • Newton’s Method
  • Convergence Rates and Condition Number
  • Acceleration Using Momentum

Readings

Chapter 9 of Convex Optimization

Chapter 8.1-8.4 of Introduction to Algorithms for Data Mining Machine Learning

Or alternatively deeplearningbook Chapter 6